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[57] ABSTRACT 

Light from an object to be imaged is optically divided 
into two portions. The first portion, preferably corre- 
sponding to one primary color, is encoded into a series 
of electrical pulses by a charge coupled device image 
sensor. The second portion corresponding to two other 
primary colors is further filtered by a striped optical 
filter and encoded into a series of electrical pulses by a 
second charge coupled device image sensor. The elec- 
trical pulses from the first and second image sensors are 
then time decoded by a decoder circuit to produce three 
color information signals. 

28 Claims, 10 Drawing Figures 
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ther case, the decoding circuitry is complex and because 

TWO SENSOR TIME ENCODED COLOR of bandwidth limitations of the vidicon, they are not 

IMAGING SYSTEM totally satisfactory. These two vidicon systems used in 

nArvrBnTTwn tup TMVUMTinxr the P rior ■neorparate such complex circuitry to 

BACKGROUND OF THE INVENTION , compensate aforementioned scanning uncertainties in 

The present invention relates to a color imaging sys- decoding the color signals generated by the vidicons. 

tern and more particularly to an improved imaging In the prior art it has also been proposed that a charge 

system using two charge coupled device (CCD) image coupled device (CCD) be used as an image sensor. For 

sensors for producing color information signals in re- instance, U.S. Pat. No. 3,801,884 issued Apr. 2, 1974, 

sponse to light received from an object. The disclosed 10 discloses the use of a CCD array in an image pickup 

color imaging system may be used as part of a color system. CCD arrays having 512 by 320 cells for use as 

television camera, particularly, a small hand held color an image sensor are currently commercially available 

television camera. from Radio Corporation of America, Lancaster, PA. 

Conventional color television camera systems gener- under the tradename SID 5 1232. Image sensing CCDs 

ate the three color signals, e.g., red, green and blue 15 are made up ofan array of charged coupled cells which 

signal, using three separate vidicon tubes. Splitting the use a clock rather than ajcanning electron beam to scan 

light coming from the object to be televised into three or interrogate the cells. Since highly accurate clocks are 

primary colors for transmission to the three vidicons known in the prior art, the CCD image sensor does not 

and the magnetic or electrostatic deflection systems suffer the non-linearity associated with the magnetic or 

associated with each vidicon have resulted in the prior 20 electrostatic deflection system of a conventional vid- 

color TV cameras being relatively large and heavy. icon. That is, a particular output pulse from the CCD 

While this prior art system produces a high quality image sensor can be associated with a particular physi- 

color signal, the bulk and weight of the camera associ- cal location on the image sensing surface of the CCD. 

ated with this system makes it difficult to use, for in- There has also been a proposal to use a single CCD 

stance, in hand held applications. 25 image sensor in a color image pickup system, as is de- 

In the prior art there have been suggestions for color scribed in U.S. patent application Ser. No. 502,289, 
television image pickup systems which utilize, for in- dated Jan. 13, 1976. This system utilizes a complex opti- 
stance, a striped optical filter and one or two vidicons, cal filter whose filter elements are arranged in an array 
or similar devices such as the "plumbicon." Since white and are sized approximately one-half the size of the 
and colored light are reproducable using three primary 30 CCD elements in the CCD array. This system further 
colors, these one or two vidicon systems must be able to provides merely one of two color information signals 
discern three primary colors. Typically, a striped opti- for each scan line in sequential fashion in addition to a 
cal filter is disposed in front of the vidicon interpreting luminance signal for each scan line, 
two or three primary colors. The striped filter causes an It is, therefore, an object of this invention to improve 
alternating pattern of narrow stripes of different color 35 color television image pickup systems, 
light from the object to fall upon the vidicon's sensitive It is yet another object of this invention to reduce the 
surface. These stripes are selected sufficiently narrow complexity of color television pickup systems, for ex- 
such that the number of different segments or portions ample, by using simplified circuits to decode the signals 
of the output signal from the vidicon, corresponding to from two CCD image sensors, to produce three color 
striped pattern of light falling on the vidicon's sensitive 40 signals suitable for use in broadcasting a color image of 
surface, provide sufficient resolution to yield a clear the object. 

picture. It is still another object of this invention to use a 

The magnetic or electrostatic deflection system used striped optical filter in conjunction with two CCD 

with a vidicon, or similar device, causes its electron image sensors to produce three color signals suitable for 

beam scan or interrogate its light sensitive surface to 45 use in broadcasting a color image of an object, 

produce an output signal; however, its electron beam It is still yet another object of this invention to sim- 

does not move with constant speed across the light plify striped filters used in two sensor color imaging 

sensitive target. While the output signal contains signal systems. 

pulses corresponding to the intensity of light falling It is another object of this invention to produce the 

along the electron beam scan line, there is an inherent 50 color information signal during each scan line produc- 

uncertainty as to the particular color of light triggering ing video information. 

a particular pulse. This uncertainty is caused by a com- It is still another object of this invention to reduce the 

bination of the non-constant speed of interrogation size of color television camera systems, 

along a scan line and the lack of means for determining It is still yet another object to produce a color televt- 

which color of light produced a particular output pulse. 55 sion camera system of lower cost than the systems gen- 

This uncertainty makes it difficult for the decoding erally in use in the prior art. 

circuitry to discern which segments of the output signal The foregoing objects are achieved according to the 
correspond to a particular primary color. Complex present invention as is now described. In a preferred 
circuits have been utilized to compensate for this uncer- embodiment of the invention, two CCD image sensors 
tainty. For instance, by using a parallel striped filter 60 are utilized. Green light from an object is directed to the 
having a different pitch stripe for each color, color first image sensor while combined red and blue light is 
information is then associated with different carrier directed to the second image sensor by a partially re- 
frequencies (in the output signal) corresponding to the flective mirror. A striped optical filter is disposed be- 
pitch of the stripes, which information can be separated tween the light source and the second image sensor 
into separate color information signals using band pass 65 such that alternating stripes of red and red + blue light 
filters. Alternatively, the prior art suggests disposing are imaged on the second image sensor's sensitive sur- 
the stripes at angles and using phase demodulation tech- face. The output from the red and red + blue image 
niques to separate the color information signals. In ei- sensor is converted into separate red and blue color 
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information signals by examining the pulses or segments coder is depicted as producing four color information 

of the image sensor signal corresponding to red stripes signals (e.g., the red, green and blue color signals as well 

of light to generate the red color information signal and as a luminance signal) because of a common usage of 

by examining the pulses or segments of the image sensor such signals in the television broadcasting industry, 

signal corresponding to red + blue stripes of light and 5 However, the matrix circuit could produce the L, I & Q 

subtracting the pulses or segments of the signal corre- signals also known in the television broadcasting indus- 

sponding to adjacent red stripes therefrom to produce try. 

the blue color information signal. Alternate embodi- Referring now to FIG. 2, there is shown an exploded 

ments disclosed use different combinations of primary perspective view of a CCD image sensor 15 with the 

colors to produce three color information output signals 10 optical striped filter 16 disposed between CCD image 

and use a striped filter which passes alternating stripes sensor 15 and object 10. The aforementioned partially 

of red and blue light. reflective mirror 13 (FIG. 1) is not shown in FIG. 2 for 

^„ ™ ^„ k „ " _ _ sake of clarity. It should also be understood that filter 16 

BRIEF DESCRIPTION OF THE DRAWINGS would %ypi ^ ly be disposed adjacent to image sensor 

FIG. 1 shows in block diagram form the paths of light 15 15. 
to the two image sensors and the paths of electrical Light from object 10 is focused by lens 11 onto the 
signals from the sensors to the output. image sensing surface 21 of image sensor 15. Light is 

FIG. 2 is an exploded perspective view of the striped inhibited from falling oh storage surface 22 of CCD 
filter disposed over an image sensor, image sensor 15, for instance by an opaque layer (not 

FIGS. 3 and 4 are cross-sectional views through the 20 shown) or other means. It should be understood, more- 
striped filter and the image sensor, over, that storage surface 22 is used to facilitate the 

FIG. 5 is a block diagram schematic of a first embodi- production of video signals which are properly timed 
ment of the system for decoding the electrical signals for use with standard broadcast television systems and 
from the image sensors, that such a storage surface is not required to operate a 

FIGS. 6(a) and (b) are graphs on which is plotted 25 CCD image sensor nor is it required in the practice of 
curves of green light, red light and blue light as well as the present invention. If storage section 22 is not used, 
the photopic response of the human eye, however, a shutter (not shown) is typically disposed 

FIG. 7 is a block diagram of a second embodiment of hptwep" n^nt in anH r_rr) j mage sensor 15~. 
the system for decoding the electrical signals from the Image sensor 15 is shown as being of the three phase 
image sensors, and : 30 frame transfer type, which can be advantaneously used 

FIG. 8 is a diagram depicting the preferred direction to produce an output signal having a 2:1 interlace, such 
of scanning in relation to the direction of stripes and as that used in standard broadcast television. It should 
FIG. Sb is a diagram depicting an alternate embodiment be understood, however, that our invention is operable 
of scanning direction. with CCD image sensors of the two or four phase frame 

A „„ •„ „„™™™r^T ^ * ^r^^ 35 transfer type as well as CCD image sensors utilizing 

: DETAILED DKCWPTION OF A FIRST other clocLg schemes. 

- EMBODIMENT jj^ sensing surface 21 and the storage sensing 

Referring now to FIG. 1 there is shown in diagram- surface 22 are each shown with 9 rows of electrodes, 
matic form our two sensor tjme encoded color tele vi- the electrodes being further grouped into 1 1 columns. 
sion image system . A ray of light 11 from an object 10 40 The electrodes in any given row are connected in com- 
to be televised passes through a lens 12 which focuses mon to one of the busses A, B, C, A', B', or C. The 
the ray of light 11 on a pair of image sensors 14 and 15. electrodes are shown as being separated into columns to 
The. ray pfliight is separated into two portions 11a and more clearly depict the light sensitive areas of the semi- 
lib Avhich are directed to the respective image sensors conductor material underlying the electrodes. The sep- 
15 and 14 bv a partially reflective mirror 1 3. Partially 45 aration between rows is exaggerated for sake of clarity, 
reflective mirror 13, in this embodiment, passes one Busses A, B, C, A', B', and C are clocked to transfer 
primary cnlnr of light whiff* 'rpfWtirig two pnmarv the charges stored under the electrodes (in a semicon- 
colors of lipht Th» rftflfiCtfld primary colors^pf ductive substrate) from image sensing surface 21 to 
li fiht in ray lie pass through a striped filter 16 befor e storage surface 22, Busses A', B\ C\ D, E and F are 
striking the sensitive surface of image jensbtLl S. In an 50 clocked to transfer the charges stored in storage surface 
alternate embodiment partially reflective mirror 13 22 to a charge detection amplifier 26 via a video output 
passes two primary colors and reflects but one primary terminal 25. Methods of clocking CCD image sensor to 
color with striped filter 16 being disposed in front of obtain a video signal are well known in the art and 
image sensor 14, resulting in a color television image therefore, we have not explained in detail the operation 
system still having one CCD image sensor producing a 55 of the CCD image sensor. 

signal corresponding to one primary color and a second Since this is a three-phase system, three adjacent 
CCD image sensor producing a signal corresponding to electrodes, separately connected to the A, B and C 
two primary colors as is produced by the embodiment busses, comprise one row of sensitive cells 20 (FIGS. 3 
depicted in FIG. 1. . and 4). The boundaries between the columns of cells 20 

The two image sensors 14 and 15 produce electrical 60 are defined by charge barriers 28 (FIG. 3) disposed in or 
signals representative of the amplitude and position of near the semiconductive substrate. Exemplary of such 
light impinging the sensitive surfaces thereof. The sig- cells, are those cells indicated by reference A, B, C and 
nals are applied to a decoder circuit 17 which decodes D. It should be evident that there are 33 such cells 20 in 
the signals and produces red, green and blue color sig- the depicted image sensing surface 21 and that it re- 
nals, as well as a liminance signal. Utilizing any three of 65 quires many more than that number of cells to produce 
the aforementioned signals, the fourth can be generated a high resolution image. 

therefrom. While the decoder circuit 17 need only pro- If interlace scanning is utilized, then the electrodes 
duce three of such color information signals, the de- are clocked differently in alternate frames to form cells 


06/24/2004, EAST Version: 1.4.1 


4,107,732 

5 6 

A, B, C, and D during one frame and intermediate cells, agreement with the three phase system depicted in FIG. 

such as the cell denoted by reference E» during a next 2, it being understood that two and four phase and other, 

frame. It should be understood that the cells are not clocking systems are as well operable in the practice of 

physically moving, rather the centers of the light sensi- our invention. 

tive area are being electrically displaced. Clocking the 5 Referring again to FIG. 1, in an embodiment in which 

image sensor 15 differently in successive frames effects semi-reflective mirror 13 transmits prgeq light find re- 

a 2:1 interlace similar to that used in standard television fle^te red and bi\y> f^nt, then ray llA> corresponds to the 

broadcasting. green light eminating from the object and ray 11a corre- 

Each light sensitive cell of image sensor 15 produces sponds to red 4> blue light would then impinge upon 

a pulse at output terminal 25 when the cells are read out 10 imngp sensoc-15 after being filtered by striped filter 16 

by properly clocking busses A, B, C, A', B', C, D, E Referring again to FIGS. 2 and 3, the first embodimen t 

and F. Each pulse is indicative of the amount of light of fftripfifl fihgr reapftfiH vrf v e lected to pass the re d 

impinging the corresponding cell since the last time a ± blue light to selected columns of cells 2Q and tqpas s 

pulse was read out of that cell. jonly red light to the interleaved columns of cells 2 0. in 

Filter 16 is arranged with stripes 17 being positioned 15 such first embodiment, the striped filter 16 depicted in 

to cause a different color light to impinge each column FIG. 3 passes, for instance, both red and blue light 

of cells. As a frame is being read out of image sensor 15, where the filter is depicted as being clear and passes 

the first pulse read out in the first scan line corresponds only red light where the filter is depicted by shading 

to the light impinging Cell A through stripe F, the lines. The output from CCD image sensor 15 comprises 

second pulse in the first scan line will correspond the 20 a series of pulses corresponding the amplitude and posi- 

light impinging cell B through stripe G and the last tion . of light impinging upon its sensitive surface with 

pulse in the last scan line will correspond to the light some pulses of the information corresponding to the red 

impinging cell C through stripe H. Thus the output + blue light impinging upon its sensitive surface and 

^final fr^TT ^-^p* c ensor 13 comprises a series of pulse s with other pulses corresponding to only the red light 

with adjacent pulses in any given scan line correspono- 25 falling upon its sensitive surface, these pulses being 

Jng to different colors of light passing througn rilter3 6T interleaved according to the pattern oi stripes forme d 
l ne pulses are typically processed by a charge 


gedetec- bv filter 16, 

tion amplifier 26 before being processed by decoder Referring now to FIG. 5, there is shown in block 
circuit 17. A charge detection amplifier is a well known diagram form a schematic at a first embodiment de- 
apparatus and is here used with the CCD image sensors 30 coder circuit 17 according to the present invention. As 
to convert the CCD output charge pulses to a suitable aforementioned, the output from the image sensor 15 
voltage or current signal for further processing. which corresponds to two colors of light is a signal 

Since accurate clocks for driving busses A, B, C, A', comprising interleaved pulses or g ftffmnttft o f rA[nr 

B', C, D, E and F are known, and since according to. formation. In FIG. 5. the output from image sensor 15 is 

the present fo wntinn, adjacent cells 20 in a scan line 35 shown as Y„, Z n + { , Y„ + 2, Z fl+ 3 r ... the capital letters 

correspond to different enters in filter - the output referring to the signal amplitude for a particular color 

pulses from image sensor 15 each correlate with the or combination of colors while the subscripts indicate 

color of light which produced such pulse to a high the time since the beginning of a scan line at which the 

degree of certainty; this certainty is not achievable with particular signals are generated by the sensor) The let- 

a conventional vidicon because of the aforementioned 40 ters X, Y and Z are used in FIG. 5 to denote the signals 

non-linearity associated with the magnetic or electros- representing the colors or combination of colors gener- 

tobe deflection circuits. In the practice of the present ated by the image sensors 14 and 15, to demonstrate the 

invention, it is desirable that the output pulses from the general applicability of this first embodiment decoding 

area imaging sensor utilized exhibit a high degree of circuit 15. The relationship of the colors X, Y & Z to the 

certainty as to the correspondence of a particular seg- 45 colon utilized in the preferred embodiment, (e.g., red, 

meat or pulse of the output signal from the device to the green and blue will henceforth be described in detail 

particular color of light from the object which gener* The output from the two color image sensor 15' (i.e., 

ated that segment or pulse. Thus, it can be seen from the the CCD image sensor 15 including striped filter 16) is 

foregoing discussion that a CCD image sensor fulfills applied to an analog switch 30 which is operated in 

this criteria. 50 timed relation to the clock interrogating the two color 

FIG. 3 is a sectional top view through image sensor image sensor 15V Techniques for operating analog 

15. Referring to FIG. 3, filter 16 is shown disposed switch 30 in timed relation to such a clock signal which 

adjacent to image sensor 15, it being understood that is indicative of which color of light produced the seg- 

filter 16 could be applied directly to image sensor 15. ment of output signal from two color image sensor 15' 

One of the electrodes 24 associated with a cell 20 is 55 then received by analog switch 30, are well known in 

shown disposed over an insulating layer 27 which is in the art Analog switch 30 has two outputs, one output 

turn disposed over a semiconductive substrate 23 providing to the Y signal at times «, n+ 2, n +4 and so 

wherein the charges for each cell 20 are stored. Channel forth and the second output providing the Z signal at 

stops 28 provide charge isolation barriers between col* times /i+l, n+3 and so forth. The Y signal is passed 

umns of cells 20. While image sensor 15 is shown with 60 through a delay circuit 31 which delays the Y signal one 

preferable front side illumination, it should be under- time segment (e.g., one pulse width), that is, pulse Y„ 

stood that the invention is also operable with back side will appear at the output of delay circuit 31 at time 

illuminated CCD image sensors. n -f 1, pulse Y a + 2 at time n + 3 and so forth. The Z signal 

FIG. 4, is a sectional aide view through CCD image is applied to one input of substracting circuit 32, the 

sensor 15 and filter 16. Filter 16 is not depicted with 65 output from delay circuit 31 being applied to the other 

stripes in this view because the section view is being input of substracting circuit 32. The Y signal, being 

taken through a single stripe. Three electrodes 24 are delayed one segment time, is substracted from the Z 

depicted as being associated with a single cell 20, in signal appearing at that segment time. Consequently, 
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the output: from substracting circuit 32 comprises a selected to represent either the white light or the green 
series of pulses corresponding to the quantities portions of the color signal for reasons which are dis- 
(Z B+1 -Y„), (Z fl+5 - Y n+4 ) and so forth. cussed below,. The bandwidth of the Z-Y and Y filters 

It is preferable to make the quantity Z- Y represent a 36 is limited to 1.50 MH* (as might bp suggested by the 
pure color to simplify later signal processing. Thus Z 5 fact that the Z-Y and Y signal frequencies are half the 
corresponds to the combined 1 light of two primary col- frequency of the X signal) to reduce the propensity of 
drs and Y corresponds to one of those two primary the system to generate moire interference patterns in 
colors; for instance, if Z were red + blue and, Y were accordance with information processing theory. Using 
. red, then Z-Y- would correspond to blue, a 1,50 MH,filter does not reduce picture quality to the 

■Again referring to the analog switch 30, the delay 10 human eye. 
circuit 31 and the T substracting circuit 32, it should be As the physical size of a source of light decreases, 
evident to one skilled in the art that the Z-Y arid Y that is, as the subtended angle of incidence in the human 
pulses occuring at the outputs of substracting circuit 32 eye loses its ability to discern; color information before 
and delay circuit 37 will each be one half the frequency it loses it ability to discern the presence of the object, 
of the signal from dual color image sensor 15 f and fur- 15 Effectively, the response of the human eye to color 
ther will have one half the duty cycle. Thus the Z-Y information- has a narrower bandpass than its response 
and Y pulses 'occur only at segment times «+ 1, n+3, to luminance information. Therefore, in color television 
ji+5; . . . To produce Z- Y and Y output signals at systems, the color signals need not have the same band- 
n +2, n +4 . . . segment times, these Z-Y and Y outputs width as the luminance signal simply because there is no 
are applied to inputs of sample and hold circuits 37 to 20 purpose in displaying information which the human eye 
cause the signals appearing at segment time n + 1 to cannot discern. 

appear at the outputs of sample and -hold circuits at Referring now to FIG. 6(a), there is graphically 
segment times «+ 1 and w+2. Similarly, inputs appear- shown, the curve of wavelength versus relative ampli- 
hig at segment time n +.3 appear at the outputs of sample tude of green light passed by partially reflective mirror 
and hold circuits 37 at segment times /i-f-3 :and; w+4. 25 13 in relation to the photopic response of the human 
Thus, the pulses representing Y and Z-Y occur at one eye. As perfect filters are difficult to manufacture, a 
half the frequency of the pulses representing X, the Y green trim filter may be used with mirror 13 to eliminate 
and Z-Y pulses being two time segments long while unwanted blue light from the light impinging image 
the X pulses are but one time : segment long. The reason sensor 14. Given the excellent correspondence between 
this lower frequency in the Z- Y and Y channels does 30 green light and the photopic curve and since the afore- 
not uhduely degrade picture quality, is subsequently mentioned insensitivity of the human eye to the color of 
discussed more fully; ~ light having small angles of incidence afTects red and 

The output from the single color sensor 14 is applied blue light before it affects green light, the higher fre- 
j V^mpIP Anri l hnld circuit 33 and thereafter to a delay quencv X color infor mation signal, which is capable of 
circuit 34 which delays the X signal one time segment, m represent!^ «nr,»lli>r oWflf^, preterably corre- 
thereby keeping it improper timing with the delayed Y y nnHc t o th* rnW prppn f or tn luminance information). 
signal. The X; Z-^ Y, and Y outputs are shown in FIG. In FIG. 6(b), the frequency distribution of the red and 
5 as a series of varying amplitude- pulses, having: the blue color light impinging two color sensor 15' is de- 
aforementioned frequency relationships. Sample and picted. The infrared response is preferably limited by an 
hold circuits 3fr and 37 are employed to capture that 40 infrared filter used with lens 12 while ultraviolet re- 
part of each CCD output pulse which contains ampli- sponse is typically limited by image sensor 15 response, 
tude information and to reject those parts which do not Thus, imthe practice of our invention, itjs, preferred 
. contain amplitude information, in addition to the previ- that the high frequen cy signal from th e single color 
ously mentioned purpose for sample and hold circuit 37. }* cnmprisp rhft ptppxi mlor mtormation while 

^Sample and hold circuits 33 and: 37 and their use with 43 the red and bln r rolor information he directed toihe 
CCD imaging arrays are well known in the prior art two color sensor 15'. Therefore, in FIG. 5, in the prac- 
A&ft new X color information pulse is generated each rice of 1 the preferred first embodiment, X may be re- 
segment time; the X pulses occur at segment times »+l, placed by G to represent green, Y may be replaced by 
n +2, n+3 and so forth; As afotementioned, the Z-Y R to represent red, Z may be replaced by B plus R to 
and Y pulses are generated'by the decoder circuit only 50 represent red plus blue and Z-Y consequently can be 
for each two segment times. The X output is then passed replaced by simply B for blue. ^Two color sensorjg ' 
through a low pass filter 35 which has bandwidth of produces intf lf ^ ved segments corresponding tn red 
approximately 3 magahertz. Similarly the Z-Y and Y plus blue and red alone utilizing the partially reflect jye 
Signals are passed through low pass filters 36 and 37 jnjrrorja which directs red plus blue lignt towards the 
each of which has a bandwidth approximately 1.50 55 CCD image sensor 15 and a red and clear striped filter 
megahertz. The outputs from the three low pass filters 16 as was previously discussed with reference to FIGS. 
35 and 36 supply three color signals and similarly the land 3. 

three outputs may be applied to the input of a luminance ^Alternatively, the X channel can c orrespond to lumi- 
. adder matrix 38 to generate a luminance signal. It can be ^nance inior ™»*ifl" rhe nartiallv reflectivemirror 13 is 
seen that the low frequency portions of the luminance 60 ^selected to pass red and blue light^ in addition to gree n 
signal, i.e., those below 1;50 megahertz comprise por- %M. tn imagq sensnr A ». jnen tne A output trom de- 
tions of X, Z-Y and Y signals whereas the higher coder circuit 17 corresponds essentially^J pUUTninaSe 
" frequency portions of the luminance signal, i.e., those information and a green matrix circuit musi oe used, in 
between approximately 1.50 megahertz and 3 mega- lieu of luminance adder 38, for instance; The green 
hertz, are made up of primarily the X signal; this depen- 65 matrix circuit is then responsive to the X fluminance), 
vdence on primarily the X signal for the higher f re- Z-Y (Tblue^ and Y (red) signals for substracting the re d 
quency portions of luminance signal provides a pleasing Wye signals from tne luminance signal to generate a 

picture to the human eye, especially if the X signal is green color information signal. The X channel is This 
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alternate embodiment provides a luminance color infor- 
mation signal. 

DETAILED DESCRIPTION OF A SECOND 
EMBODIMENT 

Referring now to FIG. 7, there is shown in block 
diagram form a schematic of a second embodiment of 
decoder circuit 17 according to the present invention, 
As in the first embodiment of decoder circuit 17, 
output from the ima^e sensor 15 which corresponds lo 
two colors of light ts a signa l comprisin g interleaved 
™ r»fl"»"i f«i of color information. In nd. 7, tne 
output from dual color sensor 15' is shown as Y m A fl+ i, 
Y n+2 > Z„ +3 , - - • - The capital letters referring to the 
signal amplitude for a particular color while the sub- 
scripts indicate the time since the beginning of the scan 
line at which the particular signals are generated by two 
color sensor 15'. The letters X, Y and Z are used in FIG. 
7 to denote the signals representing the colors generated 
by CCD image sensors 14 and 15, to demonstrate the 20 
general applicability of the second embodiment of the 
decoder circuit 17. The relationship of the colors X t Y 
and Z to the colors utilized in the second embodiment, 
e.g., red, green, and blue, will henceforth be described 
in detail. 

The output from the second embodiment of two 
color image sensor 15' comprises interleaved segments 

or pulses r^rrespontflpg to two different primary r.n1- 
.or^This differs from the first embodiment where the 
interleaved segments or pulses corresponded to pulses 30 
representing two primary colors and pulses correspond- 
ing to one of those two primary colors. In the second 
embodiment, the two different primary colors are pro- 
duced using a striped dichromatic optical filter 16 
which alternating passes only red light in one of the set 35 
of stripes and only blue light from the interleaved 
stripes. 

The output from the two color image sensor 15' is 
applied in the second embodiment to an analog switch 
30 which is operated in time relation to the clock signal 40 
which is indicative of the color of light produced by the 
segment or pulse of the output signal from two color 
image sensor 15'. Analog switch 30 has two outputs, 
one of the output corresponding to the Y color at times 
n, n+2, «+4, and so forth with another output corre- 45 
sponding to the Z color at times «+ 1, n-f 3, /i+5, and 
so forth. The Y color output and the Z color output 
from analog switch 30 are passed through sample and 
hold circuits 37 which (1) capture that part of each 
CCD output pulse which contains amplitude informa- 
tion and rejects those parts which do not contain ampli- 
tude information and (2) holds the pulse over two seg- 
ment times, similarly as was done in the first embodi- 
ment, such that the Y„ signal appears at segment times n 
and n + 1, the signal appears at segment times «+2 55 
and /i+ 3 and so forth; the X B+1 signal appears at seg- 
ment times n+1 and «+2, and so forth. The output 
from image sensor 14 is passed through a sample and 
hold circuit 33 as was done in the first embodiment. The 
X, Y and Z outputs from the three sample and hold 60 
circuits are then passed through their respective low 
pass filters 35 and 36 to produce three color information 
signals X, Y and Z. 

The decoder circuit disclosed as the first embodi- 
ment, allows stripe filter 16 to have alternating color 65 
and clear stripes thus requiring but one filter media, e.g., 
opaque to blue light, in the filter design. In the second 
embodiment, on the other hand, the striped filter 16 


50 


must have alternative stripes of filter media. Thus the 
first embodiment of the invention permits the use of a 
simpler, single media striped filter having alternating 
clear and color stripes. 

As can be seen from FIG. 7, the pulses entering X 
channel low pass filter 35 occurs at approximately twice 
the frequency as the Y and Z pulses entering Y and Z 
low pass filters 36. For the aforementioned reasons 
regarding the sensitivity of the human eye, we prefer to 
practice the second embodiment of our invention with 
the X channel corresponding to preen (or white lighti 
and the Y and *Z cnanneis correspondin g tn red and _ 
blue. 

While we prefer to practice our first and second em- 
bodiments of our invention with the X channel corre- 
sponding to the green color signal, it should be evident 
to one trai ned in the art | however, that other color 
Tnfl V he used with the present processing sys- 
tems . For instance, instead of us ing primary colors red, 
hlne and green r their ppposites may he need namely 
cyan- mftppnfn find ynllOW nr t he X chann el mav corre- 
spond to t^e lumina nce information, as aforementioned . 

Further, while the direction of scanning the image 
sensor has preferrably been shown at right angles to the 
direction of stripes and the stripe filter 16, the stripes 
may be disposed essentially parallel to the direction of 
scanning the image sensor 15. As is shown in FIGS. 2 
and 84 the scan line (labelled scan 1 - scan 5 in FIG. 8a) 
are disposed at right angles to striped filter 16, which 
alternately passes red and blue plus blue light in the 
preferred first embodiment or alternately passes red and 
flue- light in the second embodiment. pf courae T otEe r 
eofora may be used; in filter 16 as aforementioned. The 
direction of stripes may be nonperpendicular to the 
direction of scanning, for instance, parallel thereto, as 
shown in FIG. 9b. In this alternate embodiment, an 
entire scan line of video information is stored for com- 
parison with an adjacent line. 

Having described the invention in connection with 
certain specific embodiments thereof it is to be under- 
stood that further modification may now suggest itself 
to those skilled in the art. 

For instance, optical resolution reducing filters may 
be disposed between the object and image sensor 15 for 
the purpose of reducing optically produced moire pat- 
terns. Also, because it is difficult to fabricate a single 
filter having exactly the transmissivity or reflectivity 
desired, trimming filters may be used therewith to more 
closely attain the desired transmissivity or reflectivity. 
It is to be understood that the invention is not limited to 
the specific embodiments disclosed except as set forth in 
the appended claims. 

What is claimed: 

1. A method producing three color-information sig- 
nals representative of the shape and color of light re- 
ceived from an object, said method comprising: 

(a) splitting the light from the object into first and 
second portions, the first portion comprising light 
of a first primary color and the second portion 
comprising light of second and third primary col- 
ors; 

(b) encoding the first portion into a first color-infor- 
mation signal using a first charge coupled device 
image sensor, said first color signal corresponding 
to the light of said first primary color from said 
object; 
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(c) spatially filtering out light of said third primary 
color from said second portion using a striped opti- 
cal filter; 

(d) encoding the spatially filtered second portion into 
an electrical signal using a second charge-coupled 5 
device image sensor, said electrical signal compris- 
ing alternating first and second lines of video infor- 
mation said first lines corresponding to the light of 
said second and third primary colors received from 
said object and said second lines corresponding to 10 
light of said second primary color received from 
said object; 

(e) storing a selected one of said first and second lines 
of video information; 

(0 substracting the selected lines of video information 15 
and the non-selected lines of video information to 
produce a second color-information signal corre- 
sponding to the light and said third primary color 
light received from said object; and 

(g) removing said first lines from said electrical signal 20 
to form a third color-information signal, corre- 
sponding to the light of said second primary color 
received from said object. 

2. A method of producing three color information 
signals representative of light received from an object, 25 
said method comprising: 

(a) splitting light received from the object into first 
and second portions, the first portion comprising 
light of at least a first primary color, and the second 
portion comprising light of second and third pri- 30 
mary colors; 

(b) encoding the first portion into a first color infor- 
mation signal using a first charge coupled device 
image sensor, said first color information signal 
comprising a series of pulses corresponding to the 35 
light of said first primary color received by said 
first image sensor; 

(c) selectively filtering out said third primary color 
from a first part of said second portion, said first 
part of said second portion and the remaining part 40 
of said second portion separately impinging upon a 
second charge coupled device image sensor; 

(d) encoding said first and second parts of said second 
portion into an electrical signal comprised of a 
series of pulses using said second charge coupled 45 
device image sensor, said electrical signal being 
representative of the light of said second and third 
primary colors received by said second image sen- 
sor and including pulses representative of the light 
of said second and third primary colors interleaved 50 
with pulses representative of the light of said sec- 
ond primary color; 

(e) decoding said electrical signal to produce a second 
color information signal comprised of pulses repre- 
sentative of the light of said second primary color 55 
received by said second image sensor and a third 
color information signal comprised of pulses repre- 
sentative of the light of said third primary color 
received by said second image sensor, the pulses of 
said first color information signal occurring at es- 60 
sentially twice the frequency as the occurrence of 
pulses of either of said second and third color infor- 
mation signals; and 

(0 delaying said second color information signal the 
the duration of a first color information pulse. 65 

3. A method of producing three color information 
signals representative of light received from an object, 
said method comprising: 


(a) splitting light received from the object into first 
and second portions, the first portion comprising 
light of at least a first primary color, and the second 
portion comprising light of second and third pri- 
mary colors; 

(b) encoding the first portion into a first color infor- 
mation signal using a first charge coupled device 
image sensor, said first color information signal 
comprising a series of pulses corresponding to the 
light of said first primary color received by said 
first image sensor; 

(c) selectively filtering out said third primary color 
from a first part of said second portion, said first 
part of said second portion and the remaining part 
of said second portion separately impinging upon a 
second charge coupled device image sensor; 

(d) encoding said first and second parts of said second 
portion into an electrical signal comprised of a 
series of pulses using said second charge coupled 
device image sensor, said electrical signal being 
representative of the light of said second and third 
primary colors received by said second image sen- 
sor and including pulses representative of the light 
of said second and third primary colors interleaved 
with pulses representative of the light of said sec- 
ond primary color; and 

(e) decoding said electrical signal to produce a second 
color information signal comprised of pulses repre- 
sentative of the light of said second primary color 
received by said second image sensor and a third 
color information signal comprised of pulses repre- 
sentative of the light of said third primary color 
received by said second image sensor, the pulses of 
said first color information signal occurring at es- 
sentially twice the frequency as the occurrence of 
pulses of either of said second and third color infor- 
mation signals, said step of decoding said electrical 
signals including: 

(i) substracting the pulses representative of the 
light of said second primary color from the 
pulses representative of the light of said second 
and third primary colors, thereby obtaining 
pulses representative of the light of said third 
primary color alone, and 

(ii) preserving the pulses representative of the color 
of said second primary color. 

4, The method according to claim 3, wherein said 
step of decoding said electrical signal further includes 
the steps of sampling and holding said pulses representa- 
tive of light of said second primary color and said pulses 
representative of the light of third primary color, for the 
duration of two of said pulses representative of the light 
of said first primary color. 

5, The method according to claim 3, further including 
the steps of processing each of said first, second and 
third primary color information signals with a low pass 
filter. 

6, The method according to claim 3, wherein said 
first portion comprises the light of said first primary 
color essentially alone. 

. 7. A method of producing three color information 
signals representative of light received from an object, 
said method comprising: 
(a) splitting light received from the object into first 
and second portions, the first portion comprising 
light of at least a first primary color, and the second 
portion comprising light of second and third pri- 
mary colors; 
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(b) encoding the first portion into a first color infor- 
mation signal using a first charge coupled device 
image sensor, said first color information signal 
corresponding to the light of said first primary 
color received by said first image sensor; 

(c) selectively filtering out said third primary color 
from a first part of said second portion, said first 
part of said second portion and the remaining part 
of said second portion separately impinging upon a 
second charge coupled device image sensor, 

(d) encoding said first and second parts of said second 
portion into an electrical signal using said second 
charge coupled device image sensor, said electrical 
signal being representative of the light of said sec* 
ond and third primary colors received by said sec- 
ond image sensor; and 

(e) decoding said electrical signal to produce a second 
color information signal representative of the light 
of said second primary color received by said sec- 


10. The method according to claim 9, wherein said 
first, second and third color information signals each 
comprise a series of pulses the pulses of said first color 
information signal occurring at essentially twice the 

5 frequency as the occurrence of pulses of either of said 
second and third color information signals. 

11. The method according to claim 10, wherein the 
step of decoding said electrical signal is accomplished 
by separating the pulses representative of the light of 

10 said second and third primary color from the pulses 
representative of the light of said third primary color. 

12. The method according to claim 11, wherein the 
step of decoding said electrical signal further includes 
the steps of sampling and holding said pulses representa- 

15 tive of the light of said second primary color and said 
pulses representative of the light of said third primary 
color for the duration of two of said pulses representa- 
tive of the light of said first primary color. 


13. The method according to claim 11, further includ- 

o^lm^to 20 ? e ' tCpS of P roces ^ e ?. ch ofsaid first second and 
6 - third primary color information signals with a low pass 

filter. 

14. The method according to claim 8, wherein said 
third primary color is selectively filtered out from a part 
of said second portion and said second primary color is 
selectively filtered out from another part of said second 
portion using a striped optical filter. 

15. The method according to claim 14, wherein said 
striped optical filter comprises the filter having essen- 
tially constant width stripes, some of said stripes being 
of material opaque to the light of said second primary 
color and others ofsaid stripes being of material opaque 
the light of said third primary color. 

16. The method according to claim 14, wherein said 


signal representative of the light of said third pri- 
mary color received by said second image sensor, 
said step of decoding said electrical signal includ- 
ing: 

(i) substracting portions of said electrical signal 
representative of the light of said second primary 
color from adjacent portions of said electrical 
signal representative of the light of said second 
and third primary colors to produce said third 
primary color information signal, and 

(ii) preserving said portions representative of the 
light of said second primary color to form said 
second color information signal. 


25 


30 


8. A method of producing three color information 35 primary color is red, wherein said third primary 


signals representative of light received from an object, 
said method comprising: 

(a) splitting light received from the object into first 
and second portions, the first portion comprising 
light of at least a first primary color, and the second 40 
portion comprising light of second and third pri- 
mary colors; 

(b) encoding the first portion into a first color infor- 
mation signal using a first charge coupled device 
image sensor, said first color information signal 45 
corresponding to the light -of said first primary 
color received by said first image sensor; 

(c) selectively filtering out said third primary color 
from a first part of said second portion; 

(d) selectively filtering out said second primary color 50 
light from a second part of said second portion; 

(e) encoding said first and second parts of said second 
portion into an electrical signal using a second 
charge coupled device image sensor, said electrical 
signal being representative of the light of said sec- 55 
ond and third primary colors received by said sec- 
ond image sensor; and 

(f) decoding said electrical signal to produce a second 
color information signal representative of the light 
of said second primary color received by said sec- 60 
ond image sensor and a third color information 
signal representative of the light of said third pri- 
mary color received by said second image sensor. 

9. Method according to claim 8 wherein said electri- 
cal signal comprises a series of pulses, said electrical 65 
signal including pulses representative of the light of said 
second primary color being interleaved with pulses 
representative of the light of said third primary color. 


color is blue and wherein said first portion comprises 
green primary color light. 

17. A method of producing three color information 
signals representative of light received from an object, 
said method comprising: 

(a) splitting light received from the object into first 
and second portions, the first portion comprising 
light of at least a first primary color, and the second 
portion comprising light of second and third pri- 
mary colors; 

(b) encoding the first portion into a first color infor- 
mation signal using a first charge coupled device 
image sensor, said first color information signal 
corresponding to the light of said first primary 
color received by said first image sensor; 

(c) selectively filtering out said third primary color 
from a first part of said second portion, said first 
part of said second portion and the remaining part 
of said second portion separately impinging upon a 
second charge coupled device image sensor; 

(d) encoding said first and second parts of said second 
portion into an electrical signal using said second 
charge coupled device image sensor, said electrical 
signal being representative of the light of said sec- 

: ond and third primary colors received by said sec- 
, ond image 6ensor; 

(e) decoding said electrical signal to produce a second 
color information signal representative of the light 
of said second primary color received by said sec- 
ond image sensor and a third color information 
signal representative of the light of said third pri- 

. mary color received by said second image sensor; 
and 
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(f) selectively combining said first, second and third 
color information signals to produce a luminance 
signal corresponding to the amplitude and position 
of all light received by said first and second image 
sensors. 

18. A method of producing three color information 
signals representative of light received from an object, 
said method comprising: 

(a) splitting light received from the object into first 
and second portions, the first portion comprising 
green light, and the second portion comprising red 
plus blue light; 

(b) encoding the first portion into a first color infor- 
mation signal using a first charge coupled device 
image sensor, said first color information signal 
corresponding to the green light received by said 
first image sensor; 

(c) selectively filtering out blue light color from a 
first part of said second portion; 

(d) encoding said first part and a part of the remaining 
red plus blue light of the second portion into an 
electrical signal using a second charge coupled 
device image sensor, said electrical signal being 
representative of the red and blue light received by 25 
said second image sensor; and 

(e) decoding said electrical signal to produce a second 
color information signal representative of the red 
light received by said second image sensor and a 
third color information signal representative of the 
blue light received by said second image sensor. 

19. The method according to claim 18, wherein the 
light of said second primary color light is red color light 
and wherein the light of said third primary color is blue 
color light.. 

20. The method according to claim 18, wherein the 
light of said second primary color is blue color light and 
wherein the light of said third color light is red color 
light. 

21. A method of producing three color information 40 
signals representative of light received from an object, 
said method comprising: 

(a) splitting light received from the object into first 
and second portions using a partially reflective 
mirror, said mirror passing said first portion com- 45 
prising light of at least a first primary color, and 
reflecting said second portion comprising light of 
second and third primary colors; 

(b) encoding the first portion into a first color infor- 
mation signal using a first charge coupled device 50 
image sensor, said first color information signal 
corresponding to the light of said first primary 
color received by said first image sensor; 

(c) selectively filtering out said third primary color 
from a first part of said second portion, said first 55 
part of said second portion and the remaining part 
of said second portion separately impinging upon a 
second charge coupled device image sensor, 

(d) encoding said first and second parts of said second 
portion into an electrical signal using said second 
charge coupled device image sensor, said electrical 
signal being representative of the light of said sec- 
ond and third primary colors received by said sec- 
ond image sensor; and 

(e) decoding said electrical signal to produce a second 65 
color information signal representative of the light 
of said second primary color received by said sec- 
ond image sensor and a third color information 


30 


35 


60 


signal representative of the light of said third pri- 
mary color received by said second image sensor. 

22. The imaging system of claim 21, wherein said 
first, second and fourth electrical signals comprise series 
of electrical pulses. 

23. The imaging system of claim 22, wherein the 
pulses of said first electrical signal occur at essentially 
twice the frequency as the pulses of either of said sec- 
ond and fourth electrical signals. 

24. The imagaing system of claim 23 further including 
a delay circuit means for delaying said first and second 
electrical signals for a first electrical signal pulse. 

25. A method of producing three color information 
signals representative of light received from an object, 
said method comprising: 

(a) splitting light received from the object into first 
and second portions, the first portion comprising 
light of at least a first primary color, and the second 
portion comprising light of second and third pri- 
mary colors; 

(b) encoding the first portion into a first color infor- 
mation signal using a first charge coupled device 
image sensor, said first color information signal 
corresponding to the light of said first primary 
color received by said first image sensor; 

(c) selectively filtering said second portion through a 
first set of stripes of a striped optical filter to filter 
out said third primary color from a first part of said 
second portion, a second part of said first portion, 
including light of said third primary color, passing 
through a second set of stripes of said striped opti- 
cal filter; 

(d) encoding said first and second parts of said second 
portion into an electrical signal using a second 
charge coupled device image sensor, said electrical 
signal being representative of the light of said sec- 
ond and third primary colors received by said sec- 
ond image sensor; and 

(e) decoding said electrical signal to produce a second 
color information signal representative of the light 
of said second primary color received by said sec- 
ond image sensor and a third color information 
signal representative of the light of said third pri- 
mary color received by said second image sensor. 

26. The method according to claim 25, wherein said 
striped optical filter comprises a filter having essentially 
constant width stripes, some of said stripes being of 
material opaque to light of at least one primary color. 

27. The method according to claim 25, wherein said 
one primary color is blue. 

28. A color imaging system in which light including 
three primary colors is received from an object, said 
system comprising: 

(a) first means for separating at least a part of said 
received light into first and second portions, said 
first portion comprising a first one of said primary 
colors and said second portion comprising the sec- 
ond and third ones of said primary colors; 

(b) a first charge coupled device image sensor respon- 
sive to said first portion for producing a first elec- 
trical signal representative of said first primary 
color; 

(c) second means, including a second charge coupled 
device image sensor, responsive to said second 
portion for producing a second electrical signal 
representative of said second and third primary 
colors; 
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(d) an analog switch for producing third and fourth 
electrical signals from said second electrical signal, 
said third electrical signal being representative of 
said second primary color and said fourth electrical 
signal being representative of said third primary 5 
color; and 

(e) a subtracting circuit for producing a fifth electri- 


cal signal in response to said third and fourth elec- 
trical signals, said fifth electrical signal being repre- 
sentative of said third primary color, but not of said 

second primary color. 

♦ * ♦ * * 


10 


15 


20 


25 


30 


35 


40 


45 


50 


55 


60 


65 


06/24/2004, EAST Version: 1.4.1 


